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ABSTRACT 

This paper reports the results of one of the tasks of 
a study performed by Harris Corporation for the 
Defense Communications Agency (DCA). The task was to 
evaluate the ability of a set of timing/ synchroniza- 
tion subsystem features to provide a set of desirable 
characteristics for the evolving Defense Communica- 
tions System (DCS) digital communications network. 

The set of features relate to the approaches by 
which timing/synchronization information could be 
disseminated throughout the network and the manner in 
which this information could be utilized to provide 
a synchronized network. These features, which could 
be utilized in a large number of different combina- 
tions, include mutual control, directed control, 
double ended reference links, independence of clock 
error measurement and correction, phase reference 
combining, and self organizing. Some additional 
secondary features include smoothing for link and 
nodal dropouts, unequal reference weightings, and a 
master in the mutual control network. The set of 
desirable characteristics used in the evaluation of 
the features includes but is not limited to, fre- 
quency and phase accuracy, minimized propagation of 
disturbances in the network, slip free communica- 
tions as a normal mode of operation, survivability 
under stressed conditions, interoperability with 
other networks, monitorability, precise time avail- 
ability, minimized overhead requirements and cost 
effectiveness. 

The utility of each feature (and combinations 
thereof) in providing the desirable characteristics 
was evaluated by means of combined analysis and 
computer simulation. One underlying assumption was 
that of a microprocessor based nodal synchronizer 
which implemented a second order digital phase 
locked loop with an xtended range linear phase 
detector. The nodal microprocessor was also utilized 
in distributed control of the timing/synchronization 
subsystem network. 

Some of the features of the simulation model included: 
1) a single network topology of 20 nodes and 29 
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interconnecting links (a mixture of cable, satellite, 
microwave, and tropo), 2) normal variations which 
included an initial startup transient, normal path 
delay variations, natural clock frequency drifts, 
and link and nodal measurement jitter, 3) three sets 
of stress scenario and 4) sixteen combinations of 
the timing/synchronization subsystem features. 

Nodal loop parameters used in the simulation were 
not optimized but were a compromise of several con- 
flicting goals. These included maximizing utiliza- 
tion of the available reference information, pro- 
viding for rapid entry into the network, coasting 
through reference outages and minimizing the 
effects of transient and steady state reference 
perturbation^. A continuing portion of the study 
from which this paper was abstracted aims at 
optimizing these parameters. 

The relative abilities of each of the sixteen com- 
binations of the subsystem features in providing 
each of the desirable characteristics is presented 
in tabular form for easy comparison. Although this 
study is particularly concerned with the DCS 
application, the information developed could be 
applied to any extensive network. 

I. INTRODUCTION 

A large s-^tched digital communications network gives 
rise to a set A desirable characteristics for its timing/ 
synchronization subsystem. This set of desirable character- 
istics is identifiable from the mission of the communications 
network. There are a number of features which may be applied 
to the timing/synchronization subsystem in various combi- 
nations to provide the identified set of desirable charact- 
eristics to varying degrees. 

This paper reports the results of one of the tasks of a 
study performed by the Harris Corporation for the Defense 
Communications Agency (DCA). The purpose of the task was 
to evaluate the ability of several timing/synchronization 
subsystem features to provide * set of identified desirable 
characteristics for this subsystem. Although the study was 
performed specifically for the future DCS digital communi- 
cations network, many of the findings are also applicable 
to civilian digital communications networks. The approach 
used in the evaluation was combined analysis and computer 
simulation. 

The set of identified desirable characteristics for the 
future DCS digital communications network timing/synchroni- 
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zation subsystem are discussed in some detail in [1] . For 
this reason, and since they are somewhat particular to the 
DCS network but primarily self explanatory, the set of desir- 
able character! sti cs are merely listed in Section II. Since 
the set of features range from the exceedingly familiar to 
the possibly never-heard-of , a fairly detailed explanation 
of what they are is given in Section III. Attributes of the 
simulation model are given in Section IV. The results of 
the evaluation are discussed in Section V. 

II. THE DESIRABLE CHARACTERISTICS 

The set of desirable characteristics against which the 
features were compared included the following: 

1. Frequency and phase accuracy. 

2. Freedom of clocks from being disturbed by pertur- 
bations occurring further from the master than the 
local node. 

3. Freedom from propagation of clock errors except 
that of the master. 

4. No harmful propagation of a disturbance due to 
path delay variations or link dropouts. 

5. Slip free as a normal mode of operation. 

6. Survivability of the timing function. 

7. Minimum overhead communications. 

8. Precise time availability. 

9. System level moni torabi 1 i ty (functional as 
opposed to equipment monitoring). 

10. Compliance with Federal Standard 1002. 

11. Cost Effectiveness. 

12. Interoperabi 1 i ty of the digital communications 
system with other digital communications systems 
employing different synchronizing techniques. 

13. Capability to automatically select a new network 
master. 

III. THE FEATURES 

There are several optional features which can be includ- 
ed in various combinations in the DCS timing/synchronization 
subsystem. Some of the features, however, preclude incor- 
poration of certain other features. Also, some combinations 
of the features are more synergetic than others. 

1. Independent Clocks (IC) 

Figure 1 shows the form of this feature. This fea- 
ture precludes the attainment of a truly synchronized corn- 
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munications network due to the unavailability of ideal clocks. 
However, it provides a basis for many comparisons and it is 
also a natural fall back configuration for the directed or 
mutual control features, when in times of stress, all refer- 
ences are temporarily lost. It is spoof proof, its set up 
time minimal, and for a tactical military communications 
mission it may very well be the best choice. It is concep- 
tually simple from the standpoint of the timing subsystem 
itself but it is not necessarily the simplest from the stand- 
point of the digital communications equipment designer or 
user, because lack of a truly synchronized network implies 
occasional resetting of communications buffers, as well as 
an increasingly complex system of pulse stuffing to accom- 
modate growing multiplexing and switching needs. For a 
given quality of communication it is not necessarily the 
lowest cost system due to the higher implied quality of 
nodal clocks. Also, io the degree that survivability is 
reflected in the probability of bit slips and the ability to 
monitor the system for Impending failures, it does not neces- 
sarily provide as survivable a network as certain combina- 
tions of the other features, all of which are precluded by 
independent clocks. Since independent clocks do not lead 
to a synchronous network it was not included in any of the 
simulations and will not be further considered in this paper. 

2. Directed Control (DC) 

The form of the directed control feature is shown in 
Figure 2. It consists of a tree network of selected com- 
munications links over which timing information is passed 
from master node to all immediate neighbor nodes. These 
immediate neighbor nodes in turn pass timing information 
from their nodal clocks to their immediate neighbors who 
are farther removed from the master. The timing information 
only flows in one direction of the duplex links, i.e., away 
from the master. This is the central idea of a master slave 
network which is a particular case of directed control. 

Since there are no closed loops in the network, this feature 
has no network stability problems. It is a widely used 
feature in military and civilian networks [2,3,4]. It re- 
sults in a synchronized network in Which all nodes have the 
same average frequency. When combined with elastic communi- 
cations buffers of sufficient size, short term perturbations 
will not cause bit slips. Thus the network should be able 
to support communications without slips or scheduled reset- 
ting of communications buffers for an indefinite period of 
time . 



3. Mutual Control (MC) 


Figure 3 shows the form of the mutual control feature. 
It is the antithesis of directed control. Each node takes a 
weighted sum of the phase error of its local clock relative 
to that of signals received from all of its immediate neigh- 
bors to determine a correction signal to apply to its local 
clock. Since there are numerous closed loops in the network, 
care must be taken in the selection of error signal process- 
ing parameters at each node in order to insure network sta- 
bility. The network frequency under mutual control is a 
function of the weighted average of the individual nodes 
natural frequencies and the path delays of the network. This 
feature has been widely studied from a theoretical standpoint, 
mainly to investigate the questions of network stability and 
the sizes of transient and steady state phase errors in the 
system [5,6,7,8,9,10,11,12,13,14] but no major network has 
selected this feature. It's most touted attribute for a 
military mission is its survivability. 

4. Double Ended Reference Links (DE) 

Figure 4 shows a model for double ended reference 
links. This feature provides the capability to remove the 
effects of transmission delay time in the time reference in- 
formation. Each node in the timing hierarchy transmits to 
each of its immediate neighbor nodes its clock reading as 
well as the difference between its clock and that received 
from its immediate neighbor. This is sufficient information 
to remove the propagation time from the reference information. 
To see how this works, let K ^ = Tn-Tg+DsA be the difference 
between node A's clock reading ana that of node B. Notice 
that the propagation time from B to A has been explicitly 
accounted for by the term Dg^. Similarly, let Kg = Tg-T/\ + D/\g 
be the difference between tne reading of node B's clock and 
that of node A with propagation time from A to B explicitly 
expressed by D/\g. Now node B may determine the error of its 
clock relative to that of node A to within one-half the 
asymmetry of the duplex link propagation times by computing 


Ka _ Kg 

— — * (T A -T B +D BA )- (T B -T A +Dfl B ) 

“ (Ta-Tb)+(D b a-Da„)/2. 

The asymmetry Dg^-Dng of a duplex link is expected to be 
quite small if similar equipment and the same transmission 
medium is utilized in the forward and reverse paths. 


5. Independence of the Clock Error Measurement at 

Any Node from the Correction of Clock Error at 

Any Other Node (ICEM&C) 

This is a feature which may be used to remove the 
effects of phase errors in clocks intermediate between the 
local nr'de and the network master. This is accomplished by 
passing measured but uncorrected errors down the timing 
chains. Figure 5 shows how this is accomplished. When this 
feature is used in conjunction with double ended reference 
links and directed control, each node of the network is ef- 
fectively tied to the network master. This feature cannot be 
effectively applied with the mutual control feature because 
in general the'-e is no definit hierarchical path from the 
local node back to an ultimate reference. 

6. Phase Reference Combining (PRC) 

Figure 6 shows a model for the phase reference com- 
bining feature. This is a feature applicable for use in 
conjunction with DC, DE and ICtM&C which tends to reduce the 
effects of cumulative measurement errors in reference in- 
formation arriving at nodes far removed from the network 
master. This is done by combining reference information 
received at a particular node over the parallel paths from 
the network master. It is. designed to make good use of 3 : 1 
the available reference information while carefully avoiding 
closed loops in the network. Two classes of two types of 
information are passed through the system when this feature 
is utilized. The two types of information are the actual 
measured values of the reference information and an estimate 
of the statistical variance in the measured value of the 
reference information. The statistical variance is obtained 
from design parameters of the network components. It is used 
to determine how to weight the measured reference information 
received over the various parallel paths. The two classes 
of information are called class 1 and class 2. At a particu- 
lar node class 1 information of both types is obtained from 
neighbor nodes strictly above the local node in the network 
hierarchy. It is combined and used to discipline the local 
clock. The combined class 1 information is also passed to 
neighbor nodes not lower in the hierarchy than the local 
node. The clasj 2 information is obtained from neighbor 
nodes not lower in the network hierarchy than the local node. 
It is combined and passed to neighbor nodes lower in th ) 
hierarchy than the local node. The method used to combine 
the reference '■ nformation is to weight it inversely propor- 
tional to the estimated variance. 

This feature also provides for an elaborate monitor- 
ing capability. 



7. Self Organizing (SO) 


This feature is concerned with a scheme for distribu- 
ted self organization of the network Merarchy. In a system 
that does not utilize the PRC feature the implementation is 
very similar to that described by Darwin and Prim . Each 
node is assigned a rank with the network master being assigned 
a higher rank than any other node. The first alternate mas- 
ter is assigned a rank lower than the master but higher than 
any other node, etc. Each link is assigned a demerit number 
Jepending on the quality of the link. The object of the 
scheme is for each node to reference the highest ranking node 
through th>, highest quality path. It is shown in [15] that 
a network will actually do this in a stable manner when all 
rules are utilized. 

For networks using the PRC feature as described by 
Stover [1.6] the link demerit information is essentially con- 
tained in the variance information so it is only necessary 
to know the number of intervening nodes between each node 
and the master reference, as well t.s the nodal rank^nas. 

8. Master in Mutual System (MIM) 

One of the disadvantages of the mutual control fea- 
ture is that the network frequency may take random walks. 

This may be avoided by allowing one node to be the master, 
i.e., this master node doe' not reference any other node of 
the network. The result ,s tnat the long term average fre- 
quency becomes that of the master node. 

9. Smoothing for Link Dropouts and Reference 

Switching (SLD&RSS) 

The technique most commonly u c ed to discipline the 
local clock is a second order phase locked loop. A step 
change in reference phase at the input to s>ch a device 
results in a spike in output frequency whose peak amplitude 
is equal to 2£to n A4>, where c and cj n are parameters of the 
phase lock looo and A<J> is the reference phase change. This 
frequency spike ca •; have a large peak amplitude and is quite 
undesirable. Fortunately.it can be avoided. 

In a network using mutual control dropout smoothing 
consists of remembering the value of phase error relative 
to each reference immediately before the dropout. The re- 
membered value is then applied through a decaying multiplier 
for a period of time sufficient to allow the remaining ref- 
erence errors to slowly readjust, thereby avoiding the la-gt 
spike in output frequency. 



In a directed control network utilizing a second 
order loop of the integral plus proportional type the inte- 
grator voltage may be adjusted to exactly compensate for the 
difference between the old and new reference errors. Since 
the integrator has a lonq time constant the output frequency 
changes very slowly to compensate for the difference in phase 
references . 

IV. THE SIMULATION M O DEL 

A computer simulation model was developed to help evalu- 
ate the ability of the set of features described in Section 
III to provide the set of desirable characteristics listed 
in Sectic' II, though primarily for characteristics 1 through 
6. This nodel consisted of the following: 

• A nodal synchronizer 

• A network topology 

• A set of normal link and nodal variations 

• A set of stress scenarios 

• A set of fe r ture combinations 

1. The No da 1 j-chronizer 

Figure 7 shows a simplified functional block diagram 
of the nodal synchronizer. The weight am sum function is 
utilized in mutual control systems as well as directed sys- 
tems utilizing the PRC feature although the implementation 
will be considerably different for the two cases. Under 
mutual control all available references are normally select- 
ed except that failed references must be deselected. Pro- 
visions are made for either a VCXO which is directly con- 
trolled by the loop filter output or an atomic clock whose 
output is indirectly controlled by means of an outboard phase 
stepper. The phase detector(s) was modeled as an extended 
range linear device. The loop filter was one of two types, 
having transfer function or liil. The phase locked loop 

employing a loop filter of the first type results in a type 
1 loop while one employing a loop filter of the second type 
results in a type 2 loop. The type 1 loop tracks a constant 
frequency offset (local clock's natural frequency offset 
f-om reference frequency) with a constant nonzero error sig- 
nal out of the phase detector. The type 2 loop tracks a 
constant Frequency offset with a constant zero error signal 
out of the phase detector. In order to avoid network insta- 
bility problems only the type 1 loop was utilized with the 
mutuzl control feature. Either the type 1 or type 2 loop 
may be used with the directed control feature but the simu- 
Tations were run almost exclusive - ^ with the type 2 loop 
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because its performance is clearly superior to that of the 
type 1 loop. Figure 8 shows a baseline model for the phase 
locked loop. For a detailed explanation of such devices see 
tutorial papers [j.7] and [l 8] . From this model the follow- 
ing transfer functions for the type 1 and type 2 loops can 
be derived: 


Type 1 


e 0 !s) 

oTTsT 


0 !, 


s 2 + 2?co n s+u) 2 


T>pe 2 


where w 

V s ) . 
57m- ' 


where u>. 


= /ak v and 

2 ^n s ^n 2 
s 2 + 2?w n s+aj n ^ 

= /ak v and ? 


C = /a/4k. 


= /FJT 


Table 1 shows the loop parameters used in the simulation. 


TABLE 1 



Loop Parameters 

for Simulation 




w n (rad/s) 

Type 

2-DC-Quartz 

4 

5.6x10" 5 _ 

Type 

2-DC-Cesi um 

2 

1.12x10"® 

Type 

1-DC&MC-A1 1 

1 

1.52X10" 3 

2. Network Topology 



The topology of the 

network used 

in all simulations 


is shown in Figure 9. It was chosen to represent a skeleton 
of the DCS network in that link distances were chosen simi- 
lar to those that will actually be utilized in the DCS net- 
work The four gateway nodes were assumed to connect be- 
tween the r.'orth American and European continents. 

3. Normal Link and Nodal Variations 

The normal link variations were modeled as sinusoidal 
length variations about the nominal length. All except the 
tropo links were modeled with a period of one day. Measure- 
ment jitter terms were added for each link and each node for 
some of the simulation runs. Initial frequency offset was 
assumed for each clock to give an initial transient. Quartz 
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clocks were given a linear drift in natural frequency. These 
variacions are summarized in Table 2. 

4. Stress Scenarios 

The stress scenarios consisted of selected link fail- 
ures, node failures, and clock frequency changes occurring 
at various times throughout the simulation runs. Each run 
represented an e’apsed time of 300,000 seconds. The three 
sets of stress scenarios were called General, Low Level, and 
High Level. he General rtress scenario was designed to 
measure how closely nodal phases and frequencies at various 
points of the letwork would hold together under a variety of 
disturbance events. The Low Level scenario was designed to 
measure any upward propagation in the network hierarchy. 

The High Level scenario was designed to measure propagation 
either upward, laterally, or downward. The General stress 
scenario is shown in Table 3. 

5. Feature Combinations 

A total of 16 feature combinations were selected for 
incorporation into a simulation run. These are shown in 
Table 4. 

V. THE RESULTS AND CONCLUSIONS 


Resul ts ; 

Simulation runs were made for each of sixteen com- 
binations of features and three stress scenarios for a total 
of 48 simulation runs. Each simulated run was for a duration 
of 300,000 seconds. Outputs consisted of plots of absolute 
frequency error and phase error relative to node 1 of Figure 
9. Fiyures 10-lb show samples of these plots. The means 
and standard deviations of the frequency and phase errors 
were also obtained for each of the monitored nodes over the 
duration of the simulation run. The output plots and sta- 
tistical data were then compared manually for those desirable 
characteristics which could be evaluated by this technique 
(primarily characteristics 1 through 6 of Section II). The 
other seven desirable characteristics were somewhat amenable 
to analysis in light of the broad understanding of the over- 
all problem that was gained through the process of develop- 
ing the simulation model. From this narrow simulation data 
and the broad problem understanding, relative rankings of 
the ability of each of the 16 feature combinations to pro- 
vide each of the desirable characteristics was obtained. 

These rank'-gs are shown in Table 5, In order to distinguish 


446 



Table 2 

Normal Link and Nodal Variations 


LINKS: 
Link Type 

la Measurement 
Ji tter 

Normal Link Variations 

Mi crowave 

10 

AL = 10" 5 xL o xsin(u ( jt+i)> r ) 

Cable 

10 

AL * SxlO^^xtQXSinCcojt+iti,.) 

Satel 1 i te 

30 

AL - 5.04xl0" 5 xL o xsin(u) d t+if 

Tropo 

20 

AL = 10*®xL o xsi n ( <jj x t + r ) 



(lC" 4 xL 0 xsi n ( t-*-<t> r ) 



+2xl0' 5 L o xsin(8.7xl0* 4 

where $ r =0, w d 

^7.3xl0' 5 rad/s, u x = 3. 

5x10'^ rad/s and L 0 =nominal 

link distance 



NODES: 


la Measurement 


Node Numbers 

Jitter 


1,2,13, & 14 
3,4,5,6,7,8,15 & 16 
9,10,11,12,17,18,19, & 20 


10 

20 

30 


Nodal variance and weighting factor calculation 


1 



where a ^ or a^ 2 is the input variance from reference 1 or j , 
o Li 2 is the variance associated with the link between the 
reference node and the local node and c N - is the nodal variance. 
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Table 3 


General Stress Scenario 


Apply initial transient to all nodes 

Apply normal link delay variations to all links 

Apply clock drifts to all quartz clocks 


50000 s 

600U0 s 
75000 s 
100000 s 
150C00 s 

200000 s 
250000 s 


Node 6 clock starts ramp increase in frequency of 
1.16 x 10' 14 x fo per second and continues until 
75000 seconds. 

Node 1 3 1 s clock makes step decrease in natural frequency 
of 3 x lO'i* x fo. 

Node 6's clock begins ramp decrease of 1.16 x 10" 14 x 
fo per second and continues until 100000 seconds. 

Node 13's clock makes step increase of 3 x 10' 11 x fo 
in natural frequency. 

Link 6-5 fails. 

Node 5 free runs until 150300 seconds and then refer- 
ences Node 7 if sel f-reorgani zi ng . 

Node 5 free runs until 160800 seconds if nonself- 
reorgani zing.. 

Link 1-2 fails. 

Node 2 free runs until 200300 seconds it references 
Node 5 if using self-reorganization, it free runs to 
210800 seconds for nonsel f-reorgan i za ti on . 

Node 13 fails. 

Node 16 free runs until 250300 seconds at which time 
it references Node 15 if using self-reorganization. 

It free runs to 271600 seconds if using non-self 
reorganization . 


Monitor: Nodes 5, 6, 7, 2, 11, 13, 16, 17, 15, and 3 

Links 7-5, 1-6, 1-7, 6-2, 5-11, 1-13, 13-16, 16-17, 
14-15, and 2-3. 



Table 4 


Feature Combinations for Simulations 


1. Directed control with Type 1 loop (mutual sync loop parameters). 

2. Directed control with Type 2 loop. 

3. Mutual control with equal weighting. 

4. Mutual control with unequal weighting. 

3. Mutual control with a master and equal weighting. 

6. Mutual control with a master and unequal weighting. 

7. Mutual control with dropout smoothing (and equal weighting). 

8. Directed control with Type 2 loop and doubl e-ended . 

9. Mutual control with equal weighting and double-ended . 

10. Mutual control with a master, unequal weighting, dropout smoothing, 
and double-ended. 

11. Directed control with double-ended and independence of measure- 
ment and correctio n. 

12. Directed control with double-ended, independence of measurement 
and correction, and phase reference combining. 

SELF-ORGANIZING RUNS 

13. Directed control with Type 2. 

14. Directed control with double-ended, 

15. Repeat Run No. 11. 

16. Repeat Run No. 12. 
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harmful versus non-harmful propagation of disturbances, a 
criterion of harmful propagation was derived. This was pri- 
marily concerned with the probability that a disturbance 
(clock or link) would cause a bit slip in the input communi- 
cations clock recovery loop (different from the output nodal 
clock) of a node down stream from the disturbance. This was 
predicated on our knowledge of the parameters of the clock 
recovery lo'ips in existing DCS equipments. New equipments 
can be designed to handle disturbances of a given size and 
speed by selection of these parameters, albeit at a possible 
signal to noise ratio penality. The criterion is listed 
below: 



Aw 

w 0 

i 

o 

r—i 

Def i ni tely harmful . 



t— * 

o 

1 

» A 

3 o 
O 3 

< 

V— » 

O 

1 

Potentially harmful and 
SNR degradation. 

i t 

causes 

10" 10 < 

3 o 
<3 3 

< 

10 -9 

Unlikely to cause observable 
pro bl ems . 


Aw 

< 

10" 10 

No effects on slip rate 

or 

SNR. 


Using this criterion against the desirable character i sti c 
"clock errors do not harmfully propagate to other nodes" 
one clock error of 10 - 9 p-p was judged to be potentially 
harmful to some node of the network under each set of fea- 
ture combinations except the ones indicated. In the "precise 
time availability" column the YES entries do not mean that 
precise time is automatically provided by this combination 
of features but rather indicate that the essential ingredi- 
ents are provided to support an add-on unit to the nodal 
synchronizer which gives precise time. In the column titled 
"selects new master" the mutual control systems utilizing 
a master node (Runs 5,6, and 10) had no provisions for auto- 
matic selection of a new master and therefore were marked 
with NO. However, a real implementation of this combination 
of features would almost certainly require provisions for 
automatic selection of a new master. 

Conclusions : 

All features tend to do the things which they are logi- 
cally designed to do. They all proviue contributions to 
the attainment of subsets of the desirable characteris- 
tics. 
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Directed and mutual control tend to provide for a synchro- 
nized network with long term frequency averages at each 
node the same as or very close to the network frequency. 
Additionally, directed provides for long term zero aver- 
age phase error and contains disturbances in the branch in 
which they occur and only propagates them downward. 

Double-ended removes path delay variations. 

Smoothing removes undesirable large frequency spikes due 
to step changes in reference phase. 

Master in mutual system provides definite network fre- 
quency. Unequal weighting in mutual system tends to im- 
prove short term accuracy but can cause larger transients 
with link and nodal failures. 

ICEM&C removes disturbances due to independent clock 
errors in a branch of nodes. 

Phase reference combining is effective in combating 
measurement jitter and also decreases expected percentage 
of time that nodes may be without a reference during 
periods of stress. 

The simulations were performed with limited network size 
and connectivity and for very limited run time. With 
larger networks and connectivity and much longer run time 
the expected benefits from the additional features will 
be accentuated. 

Provisions for additional features (over and above mutual 
or directed control) does not seem excessive in that 
overhead data requirements are quite small and processor 
time and storage space is small i r, comparison with the 
capabilities of presently available microcomputers. 

The most striking of the additional features is the 
double-ended reference links. 

Although, according to the definition of harmful trans- 
ient, most of the disturbances due to clock errors or 
path delay variations and dropouts experienced in the 
simulation were judged to be non-harmful these events 
were mostly isolated and their amplitudes were chosen 
to represent typical events. In a real stressed envir- 
onment it is possible that several such events could 
occur closely enough together in time and at the correct 
points in the network to be harmful. The tabular summary 



indicates the combinations of features least vulnerable 
to such threats. 

• Precise time can be provided as an add-on feature to any 
scheme of control that has a master and utilizes double- 
ended links. The add-on does not affect the manner in 
which the nodal synchronizer controls the local clock's 
phase and frequency. Additional features may be used to 
improve the accuracy of disseminated time. 

• Without a master the network frequency of the mutual con- 
trol system may wander which makes interoperation diffi- 
cult. Provision of a master would then dilute "claimed" 
survivability of this method of control. Overhead is 
also required to automatically select alternate masters. 

• A disturbance occurring anywhere in the mutual control 
network propagates to all nodes of the network. 

• In order to ensure network stability in a mutual control 
system limitations are placed on the type of nodal loop. 
The disadvantages are as fo”ows: 

1. Type 1 loop tracks constant frequency offset with 
non-zero phase error. 

2. Type 1 loop tracks constantly drifting clock with 
non-zero frequency error and constantly increasing 
phase error. 

3. The above two characteristics tend to degrade the 
short term accuracy of the network. 

4. Characteristic 2. above indicates need for special 
provisions for drifting clocks, size buffer for 
lifetime operation, periodic adjustment of n* jral 
frequency, or other means. 

• Error hi tory at each node in mutual control system is 

a complex function involving network topology, reference 
weightings, stress events, and individual clock perfor- 
mance at all other nodes of the network. This makes 
it more difficult to devise a control strategy during 
intervals when a reference is not available. Thus, sur- 
vivability is decreased. This complex history also 
lessens the utility of monitored parameters at each node. 
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Figure 7: Functional Block Diagram for Nodal Synchronizer 



Figure 8: Baseline Phase Locked Loop Model 
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Figure 14 - Phase Plot for directed control with double- 

ended. Independence of fpeasuremert and correction, 
phase reference comcinlnu and seif organizing. 
General stress scenario (with jitter). 
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Figure 15 - Frequency plot For directed control with double- 
ended, independence of measurement and correc- 
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organizing. General stress scenario (with jitter) 
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QUESTIONS AND ANSWERS 

MR. DAVID OWOLO, Western Union: 

Most of the networks that both you and Ron touched on today used 
primarily terrestrial links for carrying either control or reference 
information to the various nodes, be they master or slave. What 
effects do satellite transmission links have on any of the systems 
you have discussed, and are there any special techniques that are 
more applicable to satellite linked networks than they are to 
terrestrial networks? 

MR. WILLIARD: 

I did touch on the fact in the first phase diagram I showed that 
there were satellite links assumed in three places in our network. 
The big phase variations, the 26 microseconds which I showed on that 
first phase plot, were essentially the result of the diurnal varia- 
tions of the vertical drift of satellites in the directed control 
path to those nodes. 

The use of double endedness can virtually eliminate those slow 
speed variations and not only the phase variations but the frequency 
variations also disappeared in that second set of graphs. The sim- 
ple use of directed control will virtually eliminate the effects 
that satellites have upon the distribution and timing. 

DR. HARRIS A. STOVER, Defense Communications Agency: 

Now you have seen, I think, that the mutual is not the first choice 
probably, and whatever choice you make between directed control and 
mutual, it is generally beneficial to add the additional features 
after you have made that choice. 
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